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CONSTRUCTION OF NESTED SPACE-FILLING DESIGNS 

0> ■ By Peter Z. G. Qian\ Mingyao Ai^ and C. F. Jeff Wu^ 

I University of Wisconsin-Madison, Peking University and 

Georgia Institute of Technology 

^ , New types of designs called nested space-fillmg designs have been 

. proposed for conducting multiple computer experiments with differ- 

ent levels of accuracy. In this article, we develop several approaches 
to constructing such designs. The development of these methods also 
leads to the introduction of several new discrete mathematics con- 
^-H ' cepts, including nested orthogonal arrays and nested difference ma- 

. trices. 

^' 

■ 1. Introduction. Computer models are widely used in business, engineer- 
ing and sciences to study complex real-world systems. The corresponding 
physical experimentation might otherwise be time-consuming, costly or even 
infeasible to conduct. Space-filling designs [Fang, Li and Sudjianto (2006) 
and Santner, Williams and Notz (2003)] have been widely used for conduct- 

' ing computer experiments. They include Latin hypercube designs [McKay, 

0^ ■ Conover and Beckman (1979)] and their improvements and variants [Butler 

(2001), Owen (1992, 1994b), Steinberg and Lin (2006), Tang (1993, 1998) 
and Ye (1998)]. Statistical properties of such designs have been studied in 
Loh (1996a, 1996b, 2008), Owen (1994a) and Stein (1987). Other types of 
Q"^ I space- filling designs are uniform designs [Fang et al. (2000)], quasi-Monte 

■ Carlo sequences [Niederreiter (1992)] and designs with uniform coverage 
> ; [Dalai and Mallows (1998) and Lam, Welch and Young (2002)]. 

' A large computer code, like a finite element analysis model, is often run 

\2 • variable degrees of sophistication, resulting in multiple computer exper- 
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iments with different levels of accuracy and varying computational times. 
In this article, we consider the situation in which two such experiments are 
available, and one source is generally more accurate than the other but also 
more expensive to run. As in Qian and Wu (2008), the two experiments 
considered are called the high-accuracy experiment (HE) and low-accuracy 
experiment (LE). The problem of modeling data from HE and LE has at- 
tracted a recent surge of interests. Related work includes Goldstein and 
Rougier (2004), Higdon et al. (2004), Kennedy and O'Hagan (2000, 2001), 
Reese et al. (2004), Qian et al. (2006) and Qian and Wu (2008), among oth- 
ers. Most of these methods are based on flexible Gaussian process models 
[Fang, Li and Sudjianto (2006), Sacks et al. (1989), Santner, Williams and 
Notz (2003) and Welch et al. (1992)]. 

The sets of design points for LE and HE are denoted by Di and 0^. 
Throughout the paper, LE and HE are assumed to share the same set of 
factors and the design region, for both Di and D^, are assumed to be the 
unit hypercube. As a suitable choice for Di and D^, the notion of nested 
space-filling designs (NSFDs) was introduced in Qian, Tang and Wu (2009) 
(referred to as QTW hereinafter). The basic idea is to construct a special 
orthogonal array Ai and use it to obtain an OA-based Latin hypercube 
design [Tang (1993)] for Di. Take A2 to be a subset of Ai that becomes 
an orthogonal array itself after some level-collapsing, then obtain Dh as the 
subarray of Di corresponding to A2. The constructed Di and achieve 
low-dimensional uniformity. The nested relationship C Di is appealing, 
which is also adopted in Kennedy and O'Hagan (2000), Qian et al. (2006) 
and Qian and Wu (2008). It implies that the size of Dh is smaller than that 
of Di which is desirable because LE is cheaper than HE, and more LE runs 
can be afforded. From the modeling standpoint, this structure ensures that 
for every point in D^, the outputs from both HE and LE are available, thus 
making it easier to model the differences of outputs between the two sources, 
and perform model adjustment. 

We call the above special orthogonal array nested orthogonal array (NOA). 
Its formal definition will be given in the next section. A family of NOAs with 
fixed levels was constructed in QTW based on the Rao-Hamming method 
which will be reviewed in Section 2.3. In this article, we propose a new 
approach to constructing such arrays. The principal idea is to first con- 
struct nested difference matrices and then take the Kronecker product of a 
nested difference matrix and a standard orthogonal array to obtain an NOA. 
This method is motivated by the fact that constructing a nested difference 
matrix is probably easier than the direct construction of its corresponding 
NOA. Similar considerations have been used in constructing orthogonal ar- 
rays from difference matrices [Hedayat, Sloane and Stufken (1999), referred 
to as HSS hereinafter]. As a modification of this approach, we provide an- 
other method that uses existing NOAs to obtain new ones. These methods 
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can produce many new NOAs and therefore new NSFDs. Several approaches 
for constructing NOAs with mixed levels will also be discussed. 

The remainder of the article will unfold as follows. In Section 2, some 
notation and definitions are introduced. In Section 3, an approach based 
on multiplication tables of Galois fields to constructing nested difference 
matrices is proposed. In Section 4, a general approach to constructing NOAs 
with Kronecker product is presented. In Section 5, a method is introduced 
for constructing new NOAs from existing ones. In Section 6, construction of 
NOAs with nonprime power number of levels is considered. Construction of 
NOAs with mixed levels is given in Section 7. In Section 8, the problem of 
using NOAs to obtain NSFDs is discussed. Some discussions and concluding 
remarks are provided in Section 9. 

2. Notation and definitions. 

2.1. Preliminaries. Let A = {aij) be a Latin hypercube of n runs for 
m factors that is an n x m matrix where each column is a permutation of 
1, . . . , n. Following McKay, Conover and Beckman (1979), a Latin hypercube 
design of n runs in m factors in the unit cube [0, 1)'" is generated through 
Xij = {aij — Uij)/n, I <i <n,l < j <m, where Uj/s are independent U{0, 1] 
random variables, and the n design points are given by {xn, . . . , Xim), i = 
1, . . . ,n. When such a design is projected onto each of the m factors, one 
and only one of the n points falls within each of the n small intervals defined 
by [0,l/n),[l/n,2/n),...,[(n-l)/n,l). 

A symmetrical orthogonal array (OA) of size n, m constraints, s levels, 
and strength f > 2, is an n x m matrix with entries from a set of s levels, 
usually taken as l,...,s, such that for every nxt submatrix, the s* level 
combinations occurs equally often. Regular fractional factorial designs, as 
discussed in Wu and Hamada (2000), are the most familiar examples of 
orthogonal arrays. In the article, we consider only OAs with strength two, 
denoted by OA(n,m, s). Asymmetrical OAs will be discussed in Section 7. 

Let A be an OA(n,m,s) with its s levels denoted by l,...,s. Then in 
every column of A, each level occurs q = n/s times. For each column of A, 
if we replace the q ones by a permutation of l,...,q, replace the q twos 
by a permutation of q + 1, . . . , 2q, and so on, we obtain an OA-based Latin 
hypercube [Tang (1993)]. In addition to achieving maximum stratification 
in one dimension, OA-based Latin hypercubes have attractive space-filling 
properties when projected onto 2 dimensions. 

A difference matrix (DM) is a 6 x c array with entries from a finite abelian 
group A with g elements, such that every element of A appears equally 
often in the vector difference between any two columns of the array [Bose 
and Bush (1952)]. We will denote such an array by D{b,c,g). If A is the 
additive group associated with a Galois field, we simply say its elements 
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come from the associated field. For any D{b,c,g), a column is defined to be 
uniform in A if it contains each element of A equally often. By subtracting 
the first column from all columns, any D{b,c,g) can always be converted to 
a difference matrix of the form 

(1) [Ob D^'^, 

where 0;, is the 6-dimensional zero vector and every column of D^^^ is uniform 
in A. 

Let A = {dij) and B = (bij) be, respectively, mxn and uxv matrices with 
entries from an abelian group A with binary operation * (usually addition 
or multiplication). The Kronecker product of A and B [Shrikhande (1964)], 
denoted by Ac^ B, is defined to be the mu x nv matrix 

ail * B ■ ■ ■ ain * B 



A®B- 



ami * B 
matri? 

s <v. Throughout this article * always denotes addition. 



where aij * B denotes the uxv matrix with entries aij *brs, ^ l^r <u,l ^ 



2.2. Galois field projections. For every prime p and every integer u>l, 
there exists a Galois field (or finite field) GF(p") of order p'". The additive 
group GF(p") is cyclic, and the multiplicative group GF(p")/{0} is cyclic, 
allowing easy calculations under multiplication. Throughout, the elements of 
any Galois field or any subset of a Galois field are arranged in lexicographical 
order. 

Unless stated otherwise, let si = and S2 = be powers of the same 
prime p with integers ui > U2> 1. Throughout, let F denote GF(si) with 
an irreducible polynomial pi{x), and G denote GF(s2) with an irreducible 
polynomial p2 (3;) • Let f{x) denote the elements of F and g{x) the elements of 
G, respectively. In condensed notation, let ao, • • • , ctsi-i denote the elements 
of F and /3o, . . . , Ps2-i the elements of G with oq = and /3o = 0. Next, we 
discuss two projections from F to G, serving as a basis for later development. 

The first projection, denoted by (p, is taken from Bose and Bush (1952). 

For any f{x) = cq + aix H h au2-ix'^'^~^ H h a„i_ix"i"^ G F, (j){f{x)) 

is defined by 

(2) Hfix)) = ao + aix + • • • + au^-ix""^'^. 

Because (j) works by truncating all x powers of degree U2 or higher, we call 
it the truncation projection. 

The second projection, denoted by is proposed in QTW. For any f{x) € 
F, ip{f{x)) is defined by 



(3) 



"Pifi^)) = f{x){modp2{x)). 
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Because works by taking modulus residues, we call it the modulus projec- 
tion. 

Example 1. Let p = 2, ui = 3 and U2 = 2, giving si = 8 and S2 = 4. Use 
pi{x) = x^ + X + 1 for GF(8) and p2{x) = + x + 1 for GF(4). Then the 
projection if is given as {0, + x + 1} ^ 0, {1, + x} ^ 1, {x, + 1} — > x, 
{x + l,x^} — > X + 1. 

Let 5 be either of the projections described above. For an array D with 
entries from F, 5{D) denotes the array obtained from D after the levels 
of its entries are collapsed according to 6. Clearly, the entries of S{D) take 
values in G. 

Notice that for any ai,aj S F, 

(4) 5{ai + aj) = 5{ai) + 5{aj). 

This means that the two operations 6 and + are interchangeable, which is 
critical to the constructions in Sections 4, 5 and 7. 

2.3. Nested space-filling designs and nested orthogonal arrays. Now we 
give a formal definition of NOAs, which under ly the construction of NSFDs 
in QTW. Let Ai be an OA(ni,fc, si). Suppose there is a subarray of Ai 
with size n2, denoted by A2, and there is a projection 5 that collapses the 
si levels of Ai into S2 levels. Further suppose A2 becomes an OA(n2,A;,S2) 
after the levels of its entries are collapsed according to 6. Then Ai, or more 
precisely (^1,^2), is an NOA, denoted by N0A{Ai,A2) or NOA(^i, A2, 5). 
To be emphatic about a small OA being nested within a larger OA, we say 
Ai "contains" (^(^2)- 

Let (^1,^2) be an NOA defined above. Construction of an NSFD is done 
as follows. The array Ai is used to generate an OA-based Latin hypercube 
design Di. Let Dh denote the subset of Di corresponding to A2. Then Di, 
or more precisely {Di,Dh), is an NSFD, where both Di and Dh achieve 
uniformity in low dimensions. 

The family of NOA(74i,^2)) constructed in QTW by using the Rao- 
Hamming method, has the following set of parameters: 

(i) Ai is an OA(ni, m2, si), where ni = sj^, m2 = (^2 ~ '^)/{^2 — 1) and 
/c > 2 is an integer; 

(ii) A2 is a subarray of Ai and (p{A2) is an OA{n2,m2, S2) with 71-2 = s^. 

This construction works for 2u2 < ui + 1. 
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2.4. Nested difference matrices. Let Di be a D(6i,c, si) with entries 
from F. Suppose there is a subarray of Di with 62 rows denoted by D2, 
and a projection 6 that collapses the si levels of Di into the S2 levels of G. 
Further suppose D2 is a D(b2,c, S2) if the levels of its entries are collapsed 
according to 6. Then Di, or more precisely {Di,D2), is called a nested dif- 
ference matrix (NDM), denoted by NDM(L>i,L>2) or NBM{Di, D2,S). To 
be emphatic about a smaller DM being nested within a larger DM, we say 
Di "contains" <5(L>2). 

3. Construction of nested difference matrices. In this section, we pro- 
pose an approach based on multiplication tables of Galois fields to construct- 
ing NDMs. It works for any ui> U2>1. Here the projection (p in (2) is used. 
For a scalar a and a vector c = (ci, . . . , Cm)', a + c denotes {a + ci, . . . , a-|-Cm)', 
where ' stands for vector transpose. Similarly, a + A denotes the element- 
wise sum of a scalar a and a matrix A. We focus on the case of p = 2 
and briefly discuss the case of p = 3 in the end of the section. Two sets 
or vectors are defined to be disjoint if they have no element in common. 
Because the constructions in Section 4 can use a small NDM and a stan- 
dard OA to generate a larger NOA, here we construct NDMs with up to 16 
columns. Throughout, we use the irreducible polynomial p{x) = + x + 1 
for any GF(2"), n > 1. Unless stated otherwise, let r_i = (0), tq = (0,1)', 

r„^ = {0,l,x,x + l,...,x"^ ^ h X + 1)', m > 1. Note that has 2™+^ 

elements. 

A D{si,si,si) can be obtained by constructing the si x si multiplication 
table of GF(si), where the rows and columns are labeled by all distinct 
elements of GF(si). Hereinafter, in describing such a table, we call a row (or 
column) labeled with an element f{x) G GF(si) as "row (or column) /(x)." 

3.1. A D(2'"+^22,2'"+i) containing a L»(2"", 2^, 2™) with m>2. Let 
F = GF(2"i) and G = GF(2"2) with = m + 1, ^2 = m and m > 2. Let 
-Do be the multiplication table of F. By taking columns ri of Dq, obtain a 
matrix Di. 

Collect the elements of F into two vectors: 

(5) 9i = {r'm-2,x"'~^ + r'm-2y and g2 = x"' + gi, 

where the ith. element in (72 equals its counterpart in gi plus x'^. Now place 
the rows of Di in two clusters: the top one comprising those labeled with 
rm~2 and x™" + rm,-2, and the bottom one with x™~"^ + rm-2 and x™ + 
j.m-1 This arrangement may look abstract at this moment but will 

become clear after Theorem 1. Table 1 gives cj){Di), where, for m = 2, the 
entries need to be taken modulo pi{x) = x^^ + x + 1 and then collapsed 
according to (j). 
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Take D2 to be the submatrix of Di consisting of the rows labeled with 
rjn-2 and + x™""^ -|- rm-2- Because rjn-2 is the set of polynomials of 
order at most m — 2, rm.-2 and x^~^ + rm,_2 are disjoint and their union is 
GF{2^). The following is a simple result regarding columns x and x + 1 of 
4>{Di). 

Lemma 1. (i) The vectors (x + l)rm-2 o.nd x™"^ + (x + l)r.m-2 cLre 
disjoint and their union is GF(2'"); 

(ii) the vectors (x + l)rm-2 and (x™~^ + x + 1) + (x + l)rm-2 ctre disjoint 
and their union is GF(2'"). 

(iii) the vectors xrm-2 o.nd (x + 1) + xrm-2 are disjoint and their union 
is (7^(2™). 

Proof, (i) It suffices to show that (x + l)rm-2 and x™^^ + (x + l)rm-2 
are disjoint. Assuming the contrary, then there are two elements ai and 0:2 
from rm-2 such that (x + l)ai = x"^~^ + (x + l)a2, implying (x + l)(ai — 
02) = x™~^. This is impossible because x + 1 does not divide x™"^. 

(ii) It follows from (i) by noting that (x + 1) + (x + l)rm-2 has the same 
set of elements as (x + l)rm-2- 

(iii) Assuming the contrary, then there are two elements ai and a2 from 
rm-2 such that ai — a2 — 1 = x~^, a contradiction. □ 

Theorem 1. Consider Di and D2 constructed above. For m>2, we 
have: 

(i) the matrix Di is a Z)(2™+i,22, 2™+i); 

(ii) the matrix 0(1)2) is a L»(2™, 2^, 2"^). 

Proof. Only (ii) needs a proof. Because the elements {0, 1, x, x + 1}, 
used to label the columns of Di, form an additive group, it suffices to show 
that columns l,x,x-|-l of (j){D2) are uniform in GF(2''"). Note that, due 
to the grouping scheme in (5), columns 1 and x of (j){D2) in Table 1 are 
exactly an half fraction of those of (j){Di). Then it remains to show that 



Table 1 

The matrix <j){Di) obtained from Di in Theorem 1 








1 


X 


x + 1 


rm-2 





rm-2 


xrm-2 


{X + l)rm-2 


S'" + rm-2 





rm-2 


(a:: + 1) + xrm-2 


{x + l) + {x+l)rm-2 







x"'~^+rm-2 


xrm-2 


x™-i + (x + l)r™_2 







X^'^+rm-2 


(a:: + 1) + xrm-2 


{x""-^ +x + l) + {x + l)rm- 
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column x + 1 of 4>{D2) is uniform in GF(2™). This follows from Lemma 1 as 
{x + 1) + (x + l)rm_2 and {x + l)rm„2 have the same set of elements. □ 

Example 2 [A D{2^,2,2^) containing a D(2,2,2)]. Although this ex- 
ample has only two columns, we include it here because its construction is 
similar to those in Theorem 1. Let F = GF{2'^) and G = GF(2). Let Dq be 
the multiplication table of F given by 








1 


X 


x + 1 

















1 





1 


x 


a: + 1 


X 





x 


x + 1 


1 


x+1 





a:: + 1 


1 


X 



Take Di be the first two columns of Dq. Obtain D2 as the submatrix of 
Di consisting of rows and L The matrix Di is a D(2^,2,2^), and 4>{D2) 
is a 15(2,2,2) given by 

"0 0" 

1 ■ 

Example 3 [A ^(2^, 2^, 2^) containing a L>(22, 2^, 22)]. LetF = GF(23) 
and G = GF{2'^). Take Di to be the columns of the multiplication table of 
F labeled with ri given by 








1 


X 


x + 1 

















1 





1 


X 


x + 1 


x^ 





x-" 


X + 1 


x'^ + X + 1 


x'^ + 1 





x'^ + 1 


1 


x" 


X 





X 


x^ 


x^ + x 


x + 1 





x + 1 


X^ + X 


x^ + 1 


x"^ + X 





X^ + X 


X^ +X+1 


1 


x'^ + X + 1 





x'^ +X + 1 


z^ + l 


X 



From Theorem 1, D\ is a D(2^, 2^, 2^), D2 is the submatrix of D\ consisting 
of rows 0, \,x^ + x^x^ + X + 1, and 4>{p2) is a D(22, 2^, 2^) given by 








1 


X 


X + 1 

















1 





1 


X 


a; + l 


+ x 





X 


a:: + 1 


1 


X^ +X + 1 





x + 1 


1 


X 



3.2. A I?(2™+2,22,2"'+2) containing a L»(2™,22,2") with m>2. Let 
F = GF(2"i) and G = GF(2"2) with ui = m + 2, U2 = m and m > 2. Let 
Do be the multiplication table of F. By taking columns ri of Dq, obtain a 
matrix Di. 
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Collect the elements of F into two vectors: 
(6) 

g2 = x'^ + gi. 

Now place the rows of Di in four clusters. From top to bottom, their row 
labels are: cluster 1 with rm-2 and + rm-2] cluster 2 with x'^~^ + rm-2 
and x"* + x"*~^ + rm-2': cluster 3 with x'""'"^ + rm-2 and x™+-^ + x™" + rm-2; 
and cluster 4 with x™'^-^ +x™~-^ + rm„2 and x^^^ + x"^~^ + rm-2- Table 
2 gives (j){Di), where for m = 2 or 3, the entries need to be taken modulo 
pi(x) = x"i + X + 1 and then collapsed according to (p. 

Take D2 to be the submatrix of Di consisting of the rows labeled with 
rm-2 and x'^+i + x"^ + x*""! + r^_2. 

Theorem 2. Consider Di and D2 constructed above. For m>2, we 
have: 

(i) the matrix Di is a L>(2'"+2, 2^, 2'"+2); 

(ii) the matrix 0(L>2) is a L>(2™, 2^, 2™). 

The proof of this theorem is similar to that of Theorem 1 and therefore 
omitted. 

Example 4 [A D(2^,22,2^) containing a Z?(22, 2^, 2^)]. Let F = GF(2^) 
and G = GF(22). From Theorem 2, Di is a D{2^, 2^, 2''), D2 is the submatrix 
of Di consisting of the rows labeled with (0, 1, x^ + x^ + x, x^ + x^ + x + 1)', 



Table 2 

The matrix <j){Di) obtained from Di in Theorem 2 



1 X x+1 



rm-2 rm-2 Xrm-2 {x + l)rm-2 

x'^+rm-2 rm-2 Xrm-2 {x + l)rm-2 

x"''^+rm-2 Ox"^-^+rm-2 Xrm-2 x"^^^ + [x + l)rm-2 

x"" + x""-^ + rm-2 Ox""-^+rm-2 xrm-2 x"""^ + + l)r„_2 

rm-2 {x + l) + (a: + 1) + (2; + 1) 

rm-2 (x+l)+Xrm-2 {x + 1) + {x + l)rm-2 

-2 x"""^ + rm-2 {x + 1) + xrm-2 (x™"^ + X + 1) + {x + l)r,„_2 

+ rm-2 x"'^^ + rm-2 (x + 1) + xrm-2 (x"""^ + X + 1) + [x + l)r,„_2 
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and (j){D2) is a D{2'^,2^,2^) given by 












1 


X 


x + l 





















1 









1 


X 


x + l 






+ x 





X 


x + l 


1 




+ x^ 


+ X+1 





a- + 1 


1 


X 



3.3. A D(2'"+2,23,2™+2) containing a Z)(2™+^2^2™) withm>2. Let 
F = GF(2"i) and G = GF(2"2) with m = m + 2, M2 = m and m > 2. Let Dq 
denote the multiplication table of F. By taking columns r2 of Dq, obtain a 
matrix Di. 

Collect the elements of F into two vectors: 

(7) 

g2 = x"' + gi. 

Now place the rows of Di in four clusters. From top to bottom, their row 
labels are: cluster 1 with and x"^ + r^—2'i cluster 2 with ^ + TYn—2 

and + x^~^ + rm-2\ cluster 3 with 2;"^+^ + rm-2 and + + rm-2] 

and cluster 4 with x™"*"-^ + + rm_2 and + + x™"-'^ + rm-2- 

Table 3 gives columns x^ + ri of (p{Di), where, for m = 2 or 3, the entries 
need to be taken modulus pi(x) and then collapsed according to (j), and 

a2 = ((x^ + l)r:„_3,x— 2 + (x2 + l)r:„„3)', 
as = {{x^ + x)r;„„3, x™~^ + (x^ + x)r[„„3)', 
04 = {{x"^ +X + 1) v,„3, x™"^ + x""~2 + (x^ + X + l)r;„_3)'. 
Take 1)2 to be the submatrix of Di consisting of rows rm-2, x"^ + x™~^ + 

rm-2, X'^+I + rm-2, X^+^ + X™ + X™"! + rm-2. 

Theorem 3. Consider Di and D2 constructed above. For m>2, we 
have: 

(i) the matrix Di is a L>(2"^+2, 2^, 2'"+2); 

(ii) the matrix 4){D2) is a L>(2™+\ 2^, 2™). 

Its proof is similar to that of Theorem 1 and therefore omitted. 

Example 5 [A D(25, 2^, 2^) containing a L»(24, 23,23)]. Let F = GF(25) 
and G = GF(23). We have gi = (0,1, x,x + l,x'^,x'^ + 1, x^ + x, x^ + x + 
l,x^,x'* + l,x'' + x,x^ + x + l,x'* + x^,x'^ + x^ + l,x^ + x^ + x,x^ + x^ + x+ 1)' 
and ai = (0, x^, 0, x^)', 02 = (0, x^ + 1, x, x^ + x + 1)', 03 = (0, x^ + x, x^, x)'. 



Q 
O 

;z: 

Q 

Table 3 H 

O 

2; 

O 

H 

M 
O 

m 

a 

o 
o 

M 
I — I 
Q 

w. 







Columns + ri 


0/ (t>{Di) obtained from Di 


in Theorem 3 










x'-' + 1 


X ^ -\- X 


x'^ + X + 1 


r-m-2 
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ai = {0,x'^ + x + l,x'^ + x,iy. From Theorem 3, Di is a D{2^,2^,2^), D2 is 
the submatrix of Di consisting of rows 0, 1, x, x + 1, x'^ + x^, rr"^ + + 1, x'^ + 
X^ + X, X^ + X^ + X + 1, x^, x^ + 1, x"^ + X, X^ + X + 1, x^ + x^ + x^, x^ + x^ + 
x^ + l,x^ + x^ + x2 + x,x^ + x^ + x2 + X + 1, and ct){D2) is a 15(2^,23,23), 
with columns x^ + ri of 4'{D2) given by 
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X^ + X+ 1 


X 


1 


x^ + x'^ 


x + 1 


X^ + X+ 1 


x + 1 


X^ + X + 1 


x^ + x'^ + 1 


+ X+ 1 


X 


x^ + 1 
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3.4. Some extensions. Some extensions of the proposed method are con- 
sidered here. Similar to Sections 3.1-3.3, we can construct the following 
two families of NDMs: (a) a D(2'"+3, 2^, 2'"+3) containing a L>(2™+\ 2^, 2™) 
and (b) a D(2™+3, 2^, 2"^+3) containing a Z)(2™+2, 2^^, 2"^) with m > 2. For 
brevity we present the case with m = 2, where F = GF{2^) and G = GF(22). 
By taking columns of the multiplication table of F, we obtain a matrix 
Di. Clearly, Di is a L'(2^ 2^, 2^). 

Collect the elements of F into 

51 = (ro, X + Tq, x^ + Tq, x^ + X + Tq, x" + Tq, x"^ + x + Tq, 

x^ + x^ + Vq, x^ + x^ + X + rg)' 

and 52 = +5i . Note that, for the columns labeled with r2 , the zth row in gi 
is the same as its counterpart in §2- Let D2 be the submatrix of Di consisting 
of rows (0, 1, x^ + X, x^ + X + 1, x^, x^ + 1, x^ + x^ + x, x^ + x^ + x + 1). It is 
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easy to see that 4){D2) is a D(2^,2'^,2^) given by 
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Take D3 to be the submatrix of D\ consisting of rows (0,1), + {x,x-\- 
1), + (x^, + 1), (x^ + X, X^ + X + 1), x^ + (x^, x'' + 1), (x"^ + X, X^ + X + 
l),(x^ + x^,x^-|-x^-|-l),x^-|-(x^ + x^ + x,x^-|-x^-|-x-|-l) of Di. It is easy 
to verify that (piD^) is a Z)(2^,2^,2^) with columns x^ + r2 of ^(-Ds) given 
by 
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The proposed method can be extended to construct NDMs with p = 3. 
Note that the presentation of this extension is more involved because the 
irreducible polynomials for GF(3*'), t( > 1, do not have a unified form. [In 
contrast, we can use p(x) = x" + x + 1 for any GF(2"), > 1.] For brevity 
we provide examples from a useful family: a D(3™'^^, 3^, S"^"*"^) containing a 
L»(3™,32,3'") with m> 1. 
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Here let r_i = (0), ro = (0,1,2)' , = {0,1,2, x,x + l,x + 2, ... ,2x'^ ,2x"' + 

1, . . . , 2x"' + 2x"^-^ H h 2x + 2)' with m>l. Note that here has 3™+^ 

elements. Let F = GF(3"i) with an irreducible polynomial pi{x) and G = 
GF(3"2) with an irreducible polynomial P2{x), where ui = m + 1, U2 = m 
and m>l. Let Dq be the multiplication table of F. By taking columns ri 
of Do, obtain a matrix Di. Clearly, Di is a L»(3™+\ 3^, 3"+^). 

Collect the elements of F into three vectors: 

(8) 

g2=x'^+gi and 53 = 22;'" + 5-^ . 

As a consequence of this grouping scheme, for any column labeled with tq 
in (j){Di), the rows labeled with gi are the same as those labeled with (72 or 
those labeled with g^. This convenient structure implies that we only need 
to focus on columns x + tq and 2x + rg in the construction. The key is to 
find a subset of Di in which these columns are uniform in G. Some examples 
are given. 

Example 6 [A 15(33, 3^, 3^) containing a Z)(32, 3^, 3^)]. LetF = GF(33) 
with pi{x) = x^ + 2x + l and G = GF(32) withp2(a;) = x'^ + x + 2. Let Dq be 
the multiplication table of F. By taking columns ri of Dq, obtain a matrix 
Di which is a D{3^,3^, 3^). Let D2 be the submatrix of Di consisting of rows 
ro,2x^ + x + ro and x^ + 2x + ro. It is easy to see that (j){D2) is a D{2^ ,2"^ ,2^) 
with columns x,x + l,x + 2, 2x, 2x + 1, 2x + 2 given by 
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2x 
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2x^ +X + 2 


a:: + 1 


2x 
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x^ + 2x 


x + 2 
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2a; + 2 
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x + 1 
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x^ + 2x + l 


2x + 2 
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1 


a; + 1 
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2x 


x^ + 2x + 2 


2 


2x + l 


X 


1 


2x 


x + 2 



Example 7 [A 15(3'', 3^, 3^) containing a £'(32, 3^, 3^)]. LetF = GF(3'') 
with pi{x)=x^ + x + 2 and G = GF{3^) with p2{x) =x^ + 2x + l. Let Dq 
be the multiplication table of F. By taking columns ri of Dq, obtain a 
matrix Di, which is a -0(3^, 3^, 3^). Let D2 be the submatrix of Di consisting 
of rows ri,2x^ + + ri and x^ + 2x'^ + ri. Columns x,x + l,x + 2, 2x, 2x + 
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l,2x + 2 of 0(1)2) are given by 

X X -\- 1 X -\- 2 

ri xri (x + l)ri {x + 2)ri 

2x'-^+x'^ + ri (a; + 2)+2;ri {x^ + x + 2) + {x + l)ri {2x'^ + x + 2) + {x + 2)ri 

x^ + 2x^ + ri {2x + l)+xri {2x^ + 2x + 1) + {x + l)ri {x^ + 2x + 1) + {x + 2)ri 

2x 2x + l 2x + 2 

n 2xri {2x + l)ri {2x + 2)ri 

2x'^ + x^ + ri (2a; + 1) +2a;ri (a;^ + 2a; + 1) + (2a; + l)ri (2a;^ + 2a; + 1) + (2a; + 2)ri 

a;^ + 2a;2 + ri (a; + 2) + 2xri (23;^ + a; + 2) + (2a; + l)ri (a;^ + a; + 2) + (2a; + 2)ri 



Similar to Lemma 1 it is easy to show that any two of (x + l)ri , (x + 2)ri and 
{2x + l)ri are disjoint and the union of the three is r2- Hence the columns 
of (t){D2) are uniform in r2 and 4'{D2) is a D(3^,3^,3^). 

4. Constructing nested orthogonal arrays with Kronecker products. In 

this section we present a general approach to constructing NOAs. It gener- 
ates an NOA by taking the Kronecker product of an NDM and a standard 
OA. Let 5 be either (j) in (2) or Lp in (3) unless stated otherwise. 

The following lemma [Bose and Bush (1952)] says that taking the Kro- 
necker product of an OA and a DM gives a larger OA. 

Lemma 2. If D is a D{b, c, s) and A is an OA(n, k, s), and both are based 
on the same abelian group A, then the array H = A® D is an 0A(?i6, fee, s) . 

For 5{A ^ D), we have: 

Lemma 3. If D is a D(b,c,s) and A is an OA(n,k, s) , and both are 
based on GF{s), then 

(9) 6{A®D) = 6{A)^6{D). 

This lemma can be readily verified by using the definition of 6 and (4) . It 
basically says the two operations 6 and (8) in (9) are interchangeable, which 
is key to the constructions to be proposed later. 

Now recall a classical result from Addleman and Kempthorne (1961). 

Lemma 4. If a factor in an OA has si levels and S2|si, then it can be 
replaced by a new factor with S2 levels by partitioning the si symbols into S2 
groups of size si/s2 and by replacing the symbols in the same group with a 
common symbol. The resulting array is still an OA. 

Note that if the si and S2 levels in this lemma come from GF(si) and 
GF(s2), respectively, the condition S2|si clearly holds and the required level 
collapsing can be done through using 6. 

Here is a similar result for difference matrices. 
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Lemma 5. If D is a D{b, c, si) based on GF(si), then 6{D) is a D{b, c, S2). 

This lemma can be readily proved by following the definitions of difference 
matrices and 6. 

Now we are ready to present the details of the proposed construction. 
Let A be an OA(n,m, si) based on GF(si). Let {Di,D2,5) be an NDM 
constructed in Section 3, where Di is a D{bi,c,si) based on GF(si) and D2 
is a submatrix of Di, and 5{D2) is a D{b2,c,S2) based on GF(s2)- Put 

(10) Hi = A(^Di and H2 = A(S)D2. 



Theorem 4. For Hi and H2 in (10), the array {Hi,H2,6) is an NOA, 
where Hi is an OA{nri,mc,si), H2 is a submatrix of Hi and 6{H2) is an 
0A{nr2,mc, 82)- 

This theorem can be readily verified by following Lemmas 2-5. 

Example 8. Let p = 2, ui = 3, U2 = 2, giving si = 8 and S2 = 4. Take 
an 'N'DM{Di,D2,4>) from Example 3, where Di is a L>(8,4,8) and (j){D2) 
is a 1^(4,4,4). The projection cf) is as follows: {0,x^} 0,{l,x^ + 1} ^ 
1, {x, + x} — >• x, {a; + 1, + X + 1} — > X + 1. Let A be a trivial orthogonal 
array 0A(8, 1,8), the column vector listing all elements of GF(8). From 
Theorem 4, Hi is an OA(64, 4, 8), H2 is a submatrix of Hi, and (l){H2) is an 
OA(32,4,4). 

Note that the construction (10) is not restricted to use NDMs from Section 
3. Here is an example. 

Example 9. Let Dq be the i:>(12,12,4) [Seberry (1979)] given in the 
Appendix. Take Di to be the submatrix of Dq consisting of columns 1,3,4 
and 5. It can be verified that Di is a -D(12,4, 4). Take D2 to be the sub- 
matrix of Di consisting of rows 1,2,4,5. Let 5 be a projection by deleting 
the first digits of the entries in D2. Clearly, 5{D2) is a -D(4, 4, 2). Let A be 
the OA(64, 21,4) constructed by using the Rao-Hamming method (HSS). 
Put i?i = A (g) L>i and H2 = A®D2. Then the array {Hi,H2,6) is an NOA, 
where Hi is an OA(768, 84, 4), H2 is a submatrix of Hi and 5{H2) is an 
OA(256,84,2). 
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5. Obtaining new nested orthogonal arrays from existing ones. As a 

modification of tlie method in the previous section, we discuss here a pro- 
cedure for obtaining new NOAs from existing ones. Let {Ai,A2,^p) be an 
arbitrary NOA constructed in QTW, where Ai is an OA(ni,m,si), A2 is a 
submatrix of Ai and f{A2) is an 0A(n2, m, S2). Let D be a D{b, c, si) based 
on GF(si). Put 

(11) Hi = Ai®D and H2 = A2®D. 



Theorem 5. For Hi and H2 in (11), we have: 

(i) the matrix Hi is an OA{nib,mc,si); 

(ii) the matrix H2 is a submatrix of Hi and (p{H2) is an OA(n26, mc, 82)- 

This theorem can be readily verified by foUowing Lemmas 2, 3 and 5. 

Example 10. Let p= 2, ui =3, U2 = 2, giving si = 8 and S2 = 4. We 
use pi{x) = x^ + X + 1 for GF(8) and p2ix) = x"^ + x + 1 for GF(4). The 
condition 2u2 < ui + 1 is satisfied and the projection is as follows. {0, + 
X + 1} ^ 0, {l,x^ + x} ^ l,{x,x'^ + 1} ^ x,{x + l,x^} X + 1. Take an 
N0A(^4i, ^2,^') from Section 2.3, where Ai is an OA(64,5,8) and A2 is the 
following submatrix of Ai 
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1 


1 


1 


1 


1 


1 





x + 1 


X 


X 


1 


x+1 


x^ + 1 


X^ + X + 1 


x+1 


1 


X 


X^ + X + 1 


2 

X 





X 


X 


X 


X 


1 


X 


x + 1 
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We have V3(^2) is an 0A(16, 5, 4). Let D be the multiphcation table of GF(8). 
Then D is a D{2^,2^,2^) and ip{D) is a 0(2^,2^,2"^) given by 
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X'' + 1 


x'' + X 


x'-' + X + 1 
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X^ -\- X 
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x + l 



From Theorem 5, Hi is an OA(512, 40, 8), H2 is a submatrix of Hi, and 
ip{H2) is an OA(128, 40, 8). 



6. Construction of nested orthogonal arrays with nonprime power num- 
ber of levels. In this section, we construct NOAs with nonprime power 
number of levels. This construction complements the methods in the pre- 
vious two sections, where NOAs with prime power number of levels are 
constructed. First we introduce a simple projection, denoted by pa, for any 
integer a > 1, to be 

(12) pa{u) = u{moda). 

The following lemma gives some properties of pa- 

Lemma 6. (i) Ifa,b> 1 are integers with b\a, then piy{pa{u)) =piy{u); 
(ii) for any integer a>l, Paim + U2) = Pa{Pa{ui) + pa{u2)) ■ 

We now use this projection to construct a family of NOAs based on the 
zero-sum array (HSS). For an integer s, let Z denote the residue classes 
modulo s. Let si,S2 > 1 be integers with S2|'Si. Let F denote Z^^ and G 
denote Z^j. Obtain an x 3 matrix Ai, where the first two columns have 
each of the sf possible 2-tuples from F x as a row, and for row in 
the first two columns, its corresponding entry in the third column is taken 
as —{i + j)(modsi). Take A2 to be the submatrix of Ai consisting of rows 
{hj)^ < z,j < S2 — li in the first two columns. 

Theorem 6. For Ai and A2 constructed above, we have: 

(i) the matrix Ai is an 0A(sf,3,si); 

(ii) the matrix A2 is a submatrix of Ai and ps2{-A2) is an 0A(s2j3, S2). 

This theorem can be readily verified by following Lemma 6. 
As a straightforward extension of Theorem 5, we can take the Kronecker 
product of an NOA from Theorem 6 and a standard DM to obtain a new 
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NOA. By extending Theorem 4, we can take the Kronecker product of an 
NDM with nonprime power number of levels and a standard OA to obtain 
an NOA. Here is an example. 

Example 11. Obtain a matrix Di by suppressing the first digits of all 
entries of the L>(12,6,12) in the Appendix. It can be verified that Di is 
a 15(12,6,6). Let D2 be the submatrix of Di consisting of rows 1,4,5,6,8 
and 12. Clearly, P2,{D2) is a 15(6,6,3). Let A be the OA(36,3,6) obtained 
by taking the first three columns of Table 7C.8 in Wu and Hamada (2000). 
Put Hi= A® Di and H2 = A® D2. The array {Hi,H2,P3) is an NOA, 
where Hi is an OA(432, 18, 6), H2 is a submatrix of Hi and P3{H2) is an 
OA(216,18,3). 

7. Construction of nested orthogonal arrays with mixed levels. In this 
section, we discuss the issue of constructing NOAs with mixed levels. The 
key here is to embed nested structures in the constructions of asymmetri- 
cal (mixed) OAs, like those in Wang and Wu (1991) (referred to as WW 
hereinafter) and Wang (1996). Such an embedding can be done in various 
ways as described in the remainder of the section. We use OA(n, sj^--- sj!') 
to denote an asymmetrical OA. 

7.1. Using nested orthogonal arrays and Wang-Wu method. This con- 
struction makes use of the Kronecker products in (11) and the Wang-Wu 
method in WW. For 1 <j <v, let sji and Sj2 be powers of the same prime 
Pj with integers Uji > Uj2 > 1. The primes pj^s are assumed to be all distinct. 
Suppose Ai is an OA(ni, Sj^j ' " ^vi) ^^I'i be partitioned as 

Ai = [Aii ••• A^i], 

where each Aji comes from an l>fOA{Aji,Aj2,dj), Aji is an OA{ni,kj, sji) 
based on GF(sji), Aj2 is a submatrix of Aji and 6j{Aj2) is an 0A(n2, kj,Sj2) 
based on GF{sj2)- 

For 1 < j < f, let D{j) denote a D{b,Cj,Sji) with entries from GF(sji). 
Put 

Hi = [All ^ D{1) • • • ® D{v)Bi] 



and 

H2 = [A12 D{1) ■ 

where C = (0, . . . , 6 - 1)', Bi = (C, . . . 
C appearing ui times and B2 = (C, . . 
C appearing n2 times. 



■■Am^D{v)B2], 

, Cy represents a 6-level factor with 
. , cy represents a 6-level factor with 



Theorem 7. For Hi and H2 constructed above, we have: 
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(i) the matrix Hi is an 0A(6?ii, ft^s^^f ^ • ■■s'^f''); 

(ii) the matrix H2 is a submatrix of Hi and H2 is an 0A{bn2, 8^2^^ ■ ■ ■ 
8^2^") after the levels of the Sji-level factors are collapsed according to 6j for 
j = l,...,v. 

This theorem can be readily verified by fohowing the result on the gener- 
alized Kronecker product in WW and the definition of 6j . 

Example 12 [An OA(288, 6^4^^) containing an OA(72, 3*^212)]^ 
be an OA(24, 6^4^) formed by taking all level combinations of a factor at six 
levels, 0,1,2,3,4,5, and a factor at four levels, 00,01,10,11. Take A2 to be 
the subarray of Ai consisting of all level combinations of 0, 1, 2 and 00,01. 
Let Di be the L>(12,6,6) and D2 the D(12,12,4) from the Appendix. Put 
Hi = [All <8) Di,A2i (8) D2] and H2 = [Au ^ -Di, ^22 ® D2] . From Theorem 7, 
Hi is an OA(288, 6^4^^) ^nd H2 becomes an OA(72, 3^2^^) ^^f^-gj. ^.j^g following 
level collapsing: for the 6-level factors, using {0, 3} —f 0, {1, 4} —f 1, {2, 5} — > 
2; for the 4-level factors, deleting the first digit and retaining the second, for 
example, both 01 and 11 are projected to 1. 

7.2. Using nested difference matrices and Wang-Wu method. This con- 
struction makes use of the Kronecker products in (10) and the Wang-Wu 
method in WW. 

For I < j <v, let Sji and Sj2 be powers of the same prime pj with integers 
Uji > Uj2 > 1. The primes pj's are assumed to be all different. Suppose A is 
an OA(?i, ■ ■ ■ ^vi) '^^^ partitioned as 

where Aj is an OA{n,kj,Sji) based on GF(sji). Let D he a partitioned 
matrix 

[Di{l) ■•• Di{v)], 

where -Di(j) comes from an NDM{Di{j), D2{j),6j), Di{j) is a D{bi,Cj,Sji) 
based on GF(sji), D2{j) is a submatrix of Di{j), and 5j{D2{j)) is a D{b2,Cj, 
Sj2) based on GF(sj2)- 
Put 

Hi = [Ai(^Di{l)---A^(^Di{v)Bi] 

and 

H2 = [Ai(g}D2{l)---Ay(g)D2{v)B2], 

where Ci = (0, . . . , 61 — 1)', Bi = (C(, . . . , C[)' represents a 61-level factor 
with Ci appearing n times, C2 = (0, . . . , 62 — 1)' is a subvector of Ci with 62 
elements and B2 = (C2, . . . , C2)' represents a 62-level factor with C2 appear- 
ing n times. 
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Theorem 8. For Hi and H2 constructed above, we have: 

(i) the matrix Hi is an OA{bin, b\s'lY'^ ■ ■ ■ s'^f"); 

(ii) the matrix H2 is a submatrix of Hi and H2 becomes an 0A{b2n, 62^12'^ 
■ ■ ■■5^2'^") <ifter the levels of the Sji-level factors are collapsed according to 6j 
for j = l,...,v. 

This theorem can be readily verified by following the result on the gener- 
alized Kronecker product in WW and the definition of Sj . 

7.3. Using a nested nonorthogonal mixed matrix and a special mixed dif- 
ference matrix. Wang (1996) constructs an asymmetrical OA using a mixed 
DM and a nonorthogonal matrix with mixed levels. Unlike the Wang-Wu 
method, this construction does not use OAs and therefore can give asym- 
metrical OAs with more flexible run sizes. Here we modify it to construct 
NOAs with mixed levels. 

For j = 1,2, let Sji and Sj2 be powers of the same prime pj with integers 
Uji > Uj2 > 1. For j = 1,2, choose an l^DM.{Dji,Dj2,5j), where Dji is a 
D{ni,kj,Sji) based on GF(sji), Dj2 is a submatrix of Dji and 5j{Dj2) is a 
D{n2,kj,Sj2) with entries from GF(sj2)- Construct an NDM(L'oi) -D02, ^o)) 
where 5o = 5i x 82, Dqi is a D{ni,kQ,siiS2i) based on GF(sii) x GF(s2i), 
Dq2 is a submatrix of Dqi and (5o(Do2) is a -D(n2, fcoi •S12S22) based on 
GF(si2) X GF(s22)- For j = 1, 2, let <7j(-) denote the operation of taking the 
jth component of every entry in a matrix whose entries are represented by 
two digits. For j = 1, 2, further assume the augmented matrix [aj{DQi), Dji] 
is a D{ni,ko + kj,Sji) and 5j[aj{DQ2), Dj2] is a D{n2,kQ + kj,Sj2)- For 
j = 1,2, let Cj be the column vector comprising all level combinations of 
GF(sij) and GF(s2i). 

Put 

Hi = [Ci (g)Doi,(^i(Ci) 0-Dii,cJ2(Ci) 0D21] and 

(13) 

H2 = [C2(S)Do2,Cri{C2)<^Di2,a2iC2)<^D22]. 



Theorem 9. For Hi and H2 in (13), we have: 

(i) the matrix Hi is an OK{niSiiS2i,{siiS2i)^° s\\s^); 

(ii) the matrix H2 becomes an OA(n2Si2S22, (■si2'S22) ^"5^^522) after the 
levels of the siiS2i-level factors are collapsed according to 5q and the levels 
of Sji-level factors are collapsed according to 5j for j = 1,2. 

This theorem can be readily verified by following the theorem in Wang 
(1996) and the definition of 5j. 
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We now give a simple method for constructing a type of matrix D = [Dq, 
Di,D2] required by the preceding theorem. (As a side note, this construc- 
tion is related to Problem 6.17 in HSS, page 144.) For j = 1,2, take Dj to 
be a D{bj,Cj,Sj) based on GF(sj). Let cq be any integer between 1 and 
min(ci,C2). For j = 1,2, partition Dj as Dj = [DjQ,Dji], where both Diq 
and D20 have cq columns. Let a^^fc denote the {i,k)tli entry of Di and 
the (j, k)th entry of D2. Construct a 6162 x cq matrix Dq whose entry in the 
{{i — 1)62 + i)th row and kth column is {ai^kiPj,k)i 1 < ^ < bi, 1 < i < ^2, 1 < 
k < Cq. Define D = [Dq, Dl-^^, D21], where the {{i - 1)62 + j)th row of Dl^ is 
the ith. row of Dn and the ((i — 1)62 + I'ow of D21 is the jth row of 

1^21. 

Lemma 7. For D constructed above, we have: 

(i) the matrix Dq is a difference matrix £'(6162, cq, S1S2); 

(ii) for j = 1,2, the matrix D*^ is a difference matrix D{bib2,Cj — co,Sj); 

(iii) for j = 1,2, [aj{DQ), D*-^] is a difference matrix D{bib2,Cj,Sj). 

Example 13 [An OA(144, 12^423^) containing an OA(72, 6^223^)]. Let 
Cio be the vector listing all level combinations of GF(4) and GF(3). Denote 
by 0,l,x,x + 1 the elements of GF(4) are 0,1,2 the elements of GF(3). 
For j = 1,2, let Cij be the column vector listing all jth digits of Cio- The 
transpose of the matrix Ci = (Cio, Cn, C12) is given by 

"00 01 02 10 11 12 xO xl x2 {x + 1)0 (x + l)l (3; + 1)2" 

OOOlllxxj; x + 1 x + 1 x + 1 
.012012012 1 2_ 

Let C2 = (C20, (^21, C22) be the submatrix of Ci consisting of the first six 
rows. Take Di to be the following 25(4,4,4) 



"0 








" 





1 


X 


x+1 





X 


x + 1 


1 


.0 


x+ 1 


1 


X 



and D2 to be the following 15(3,3,3) 

"0 0" 

1 2 

2 1 
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From Lemma 7, D = [Dq, Di, D2] is 



"00 


00 








0" 


00 


01 








2 


00 


02 








1 


00 


10 


X 


x + 1 





00 


11 


X 


x + 1 


2 


00 


12 


X 


x + 1 


1 


00 


xO 


x+1 


1 





00 


xl 


x + 1 


1 


2 


00 


x2 


x + 1 


1 


1 


00 


(x + l)0 


1 


X 





00 


(a; + l)l 


1 


X 


2 


.00 


(x + l)2 


1 


X 


1. 



Put Hi = [Cio (g) L»o , Cii ® , C12 O D2] and H2 = [C20 (S> Dq , C21 Di , C22 ® 
D2]. Prom Theorem 9, Hi is an OA(144, 122423^) and H2 becomes an OA(72, 
6^223^) after the following level collapsing: for the 12-level factors, using 
{00,xO} ^00, {10,(x + l)0} ^ 10, {01,xl} ^01, {ll,(x + l)l} ^ 11, {02, x2} 
02, {12, (x + 1)2} 12; for the 4-level factors, using {0, 2} ^ and {1, 3} 
1. 

8. Generation of nested space-filling designs. In this section, we discuss 
the problem of using NOAs to generate NSPDs. Throughout, we assume 
the factors are quantitative and each of them takes values in the interval 
[0,1]. When we say that a design is space-filling or achieves uniformity in 
low dimensions, we mean that, when projected onto low dimensions, the 
design points are evenly scattered in the design region. Por this problem, 
we present an approach following the procedure in QTW used for the same 
problem. Unlike QTW, the present approach covers both NOAs with equal 
levels and with mixed levels. Consider an NOA(//i, i72), where Hi is an 
OA{ni, sJl ■ ■ ■ s1\) with m = J2i=i 7i) H2 is a submatrix of Hi and H2 be- 
comes an 0A(n2, • ■ • 5^2) after the levels of the Sji-level factors are col- 
lapsed into Sj2 levels according to a projection 6j . k = 1, this array reduces 
to an NOA with equal levels. 

The first step in constructing an OA-based Latin hypercube design Di 
using Hi is to relabel the Sji levels of Hi, currently represented by the 
elements of a Galois field (or other mathematical structures), as 1, . . . ,Sji. 
Note that the projection 6j divides the Sji levels into Sj2 groups, each of size 
ej = Sji/sj2, and two levels belong to the same group if their projected values 
match. To ensure that the subset of Di corresponding to H2 has good space- 
filling properties, we label the sji levels of any Sji-level factor in Hi in such 
a way that the group of levels that are mapped to the same level should form 
a consecutive subset of {1, . . . , sji}. The Sj2 groups are arbitrarily labeled 
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as groups l,...,Sj2, and the ej levels within the ith group are arbitrarily 
labeled as (z — l)ej + 1, . . . , (i — l)ej + ej for i = 1, . . . , Sj2- 

After labeling the levels of the Sj-level factors of Hi as l,...,Sji, j = 
1, . . . , fc, as discussed above, we now use this array to obtain an OA-based 
Latin hypercube design as described in Section 2.1. Let Di denote the set of 
points and Dh be the subset of Di corresponding to H2. Then (i) Di achieves 
maximum uniformity in one dimension and, when Di is projected onto the 
dimensions of an Sji-level factor and an Sfci-level factor, the points achieve 
uniformity on sji x s^i grids; and (ii) Df^ is a subset of Di and, when Di is 
projected onto the dimensions of an Sji-level factor and an s^i-level factor, 
the points achieve uniformity on Sj2 x Sk2 grids. 

An example is given to illustrate the above procedure. 

Example 14. Consider the NOA in Example 8, where Hi is an OA(64, 
4,8), H2 is a submatrix of Hi and (j){H2) is an OA(32,4,4). The four groups 
of levels of Hi are {0, x^}, {1, x'^ + 1}, {x, x^ + x\ and {x + 1, + x + 1}. 
We label {0,x^} as levels 1 and 2, {l,x^ + 1} as levels 3 and 4, {x,x^ + x} 
as levels 5 and 6 and {x + 1, x^ + x + 1} as levels 7 and 8. Table 4 presents 
the array Hi after using such labeling, where H2 correspond to runs 1, 2, 
7-10, 15-18, 23-26, 31-34, 39-42, 47-50, 55-58, 63-64. We then use Hi to 
construct an OA-based Latin hypercube design D/ for xi to X4. Now choose 
Dh to be the subset of Di corresponding to H2. The points in any bivariate 
projection of D]^ achieve uniformity on the 4x4 grids in two dimensions. 
The points in the bivariate projections of Di also achieve similar uniformity. 

9. Discussions and concluding remarks. Multiple computer experiments 
with different levels of accuracy have become prevalent in business, engineer- 
ing and science for studying complex real world systems. NSFDs are attrac- 
tive for such experiments. Several methods are proposed for constructing 
various families of NOAs, which can be used to generate many new NSFDs. 
In the development of these methods, two new discrete mathematics con- 
cepts, called nested orthogonal arrays and nested difference matrices, are 
introduced. These concepts should be further studied in their own right. 

NSFDs can also be used in validation of computer models, that is, testing 
the accuracy of a computer model against some field data [Bayarri et al. 
(2007), Kennedy and O'Hagan (2001) and Oberkampf and Trucano (2007)]. 
Let Dc denote the set of design points for the computer model and Df denote 
the set of design points for the corresponding physical experiment used as a 
benchmark in the validation. Unlike the situation of Di and -D/j, should 
have more columns than Dj because of the need of accommodating calibra- 
tion (tuning) parameters that appear in the computer model only. Precisely, 
construction of and Dj is guided by the following requirements: 
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Table 4 
The Hi matrix in Example I4 



Run # 




X2 


2:3 


:C4 


Run # 


Xl 


X2 


X3 


a;4 


1 


1 


1 


1 


1 


33 


2 


2 


2 


2 


2 


1 


3 


5 


7 


34 


2 


4 


6 


8 


3 


1 


2 


7 


8 


35 


2 


1 


8 


7 


4 


1 


4 


3 


2 


36 


2 


3 


4 


1 


5 


1 


5 


2 


6 


37 


2 


6 


1 


5 


6 


1 


7 


6 


4 


38 


2 


8 


5 


3 


7 


1 


6 


8 


3 


39 


2 


5 


7 


4 


8 


1 


8 


4 


5 


40 


2 


7 


3 


6 


9 


3 


3 


3 


3 


41 


4 


4 


4 


4 


10 


3 


1 


7 


5 


42 


4 


2 


8 


6 


11 


3 


4 


5 


6 


43 


4 


3 


6 


5 


12 


3 


2 


1 


4 


44 


4 


1 


2 


3 


13 


3 


7 


4 


8 


45 


4 


8 


3 


7 


14 


3 


5 


8 


2 


46 


4 


6 


7 


1 


15 


3 


8 


6 


1 


47 


4 


7 


5 


2 


16 


3 


6 


2 


7 


48 


4 


5 


1 


8 


1 7 







c; 


<J 


AQ 


u 


R 
U 


« 
u 


« 
u 


18 


5 


7 


1 


3 


50 


6 


8 


2 


4 


19 


5 


6 


3 


4 


51 


6 


5 


4 


3 


20 


5 


8 


7 


6 


52 


6 


7 


8 


5 


21 


5 


1 


6 


2 


53 


6 


2 


5 


1 


22 


5 


3 


2 


8 


54 


6 


4 


1 


7 


23 


5 


2 


4 


7 


55 


6 


1 


3 


8 


24 


5 


4 


8 


1 


56 


6 


3 


7 


2 


25 


7 


7 


7 


7 


57 


8 


8 


8 


8 


26 


7 


5 


3 


1 


58 


8 


6 


4 


2 


27 


7 


8 


1 


2 


59 


8 


7 


2 


1 


28 


7 


6 


5 


8 


60 


8 


5 


6 


7 


29 


7 


3 


8 


4 


61 


8 


4 


7 


3 


30 


7 


1 


4 


6 


62 


8 


2 


3 


5 


31 


7 


4 


2 


5 


63 


8 


3 


1 


6 


32 


7 


2 


6 


3 


64 


8 


1 


5 


4 



(i) Dc contains all factors of Df and has additional columns to accom- 
modate the calibration parameters. 

(ii) When restricted to the shared factors, Df C Dc- 

(iii) Both Dc and Df have good space-filling properties. 

With slight modifications, our construction methods for Dh and Di can 
give Df and Dc that satisfy the above requirements. For illustration, we 
modify the construction in Section 3.1, where F = GF(2"'+^), G = GF(2™), 
m> 2, Do is a D(2™+\ 2™+\ 2™+i) and L»i is a Z)(2'"+\ 2^ 2™+i). Take 
Dl to be -Do- Then Dl has more columns than Di. Next replace Di by D^ 
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and follow through the steps in Section 3.1 and the construction in (10). 
Let A be the OA(n,c, si) used in Theorem 4. Then we have the following 
results: for m>2, 

(i) the matrix Dl is a D(2™+\ 2™+\ 2™+i); 

(ii) the matrix (f>{D2) is a L»(2™, 2^, 2™); 

(iii) the matrix Hl = A(^Dl is an 0A(n2™+\ 2"+ic, 2™+i); 

(iv) for the shared 4?tt-2 factors, H2 = A® D2 is a submatrix of HI and 
5{H2) is an 0A(n2™, 4c, 2™). 

As in Section 8, we use {Hl,H2) to generate a pair of nested designs for 
Dc and Df, where Dc has 2'"+^c columns and Dj has 4c columns and both 
have good space- filling properties. 

Extensions of the present work can be made in several directions. First, 
similar to the construction of OA-based Latin hypercubes designs [Tang 
(1993, 1994) and Leary, Bhaskar and Keane (2003)], it is possible to pro- 
duce multiple NSFDs based on a given NOA. In a separate article, we plan to 
use both distance and correlation criteria to construct optimal NSFDs. Sec- 
ond, the constructed NOAs in this article have strength 2 that can guarantee 
uniformity in two dimensions only. The proposed methods can be extended 
to produce NOAs with higher-dimensional stratification by exploring nest- 
ing in difference matrices with strength 3 or higher [Hedayat, Stufken and 
Su (1996)]. Another possibility is to use quasi- Monte Carlo sequences, like 
nets [Niederreiter (1992)]. A paper in preparation will address the issue of 
constructing nested nets. Third, it is worth studying the sampling properties 
of NSFDs. Fourth, a natural extension of the present work is to construct 
NSFDs for experiments with more than two levels of accuracy. One way to 
achieve this is to extend the method in QTW to directly construct NOAs 
with more sophisticated nesting, that is, a 32-run OA contains a 16-run OA 
that contains an 8-run OA. Another possibility is to modify the method in 
Section 3 to obtain NDMs with nesting at more than two levels and then use 
them to produce the desired NOAs. Finally, given the close connections be- 
tween OAs and coding theory, it should be possible to use coding-theoretical 
techniques to construct new NOAs. We are currently exploring this issue. 
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APPENDIX 

£'(12,12,4) from Seberry (1979) 



00 


00 


00 


00 


00 


00 


00 


00 


00 


00 


00 


00 


00 


00 


00 


01 


01 


01 


11 


11 


11 


10 


10 


10 


00 


00 


00 


11 


11 


11 


10 


10 


10 


01 


01 


01 


00 


11 


01 


10 


01 


11 


01 


10 


00 


11 


00 


00 


00 


11 


01 


11 


10 


01 


00 


01 


10 


10 


11 


00 


00 


11 


01 


01 


11 


10 


10 


00 


01 


00 


10 


11 


00 


01 


10 


11 


00 


10 


01 


00 


11 


01 


11 


10 


00 


01 


10 


10 


11 


00 


11 


01 


00 


10 


01 


11 


00 


01 


10 


00 


10 


11 


00 


11 


01 


11 


10 


01 


00 


10 


11 


01 


10 


00 


01 


11 


10 


01 


00 


11 


00 


10 


11 


00 


01 


10 


10 


01 


11 


11 


01 


00 


00 


10 


11 


10 


00 


01 


11 


10 


01 


00 


11 


01 



-0(12,6,12) based on (Z2(Bl'6,+) [Dulmage, Johnson and Mendelsohn 
(1961)] 



00 


00 


00 


00 


00 


00 


00 


01 


03 


12 


04 


10 


00 


02 


10 


01 


15 


12 


00 


03 


01 


15 


14 


02 


00 


04 


13 


05 


02 


11 


00 


05 


15 


13 


11 


01 


00 


10 


02 


03 


12 


13 


00 


11 


12 


14 


10 


15 


00 


12 


05 


02 


13 


04 


00 


13 


04 


11 


01 


14 


00 


14 


11 


10 


03 


05 


00 


15 


14 


04 


05 


03 
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